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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 

WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 10 July 2007 . 
2a)D This action is FINAL. 2b)K This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) E3 Claim(s) 10,11.15-17,19,20,24 and 25 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) [Xj Claim(s) 10-11. 15-17. 19-20. 24-25 is/are rejected. 

7) D Claim(s) is/are objected to.- 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)^ The drawing(s) filed on 02 February 2002 is/are: a)S accepted or b)Q objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
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1 .□ Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
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Detailed Action 
Response to Communication dated 07/10/2007 

1. Claims 10-11, 15-17, 19-20, 24-25 are presented for examination. 

Continued Examination Under 37 CFR 1.114 

2. A request for continued examination under 37 CFR 1.1 14, including the fee set forth in 37 CFR 
1.17(e), was filed in this application after final rejection. Since this application is eligible for continued 
examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the 
finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's 
submission filed on 07/1 0/2007 has been entered. 

Response to Arguments 

3. Applicant's arguments with respect to claims 10-11, 15-17, 19-20, 24-25 have been considered 
but are moot in view of the new ground(s) of rejection. New ground(s) of rejection are necessitated by 
Applicant's amendment. 

Claim Objections 

4. Claims 10-11, 15-17 are objected to because of the following informalities: 

i) Regarding claims 10 and 17, "said displayed image" lacks sufficient antecedent basis and 
will be considered as "said image of content displayed". 

ii) Regarding claim 10, "said first display device" lacks sufficient antecedent basis since the 
claim recites "a first display", "said first display device" will be considered as "said first 
display". 

Appropriate correction is required. 
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Claim Rejections - 35 USC § 112 

5. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

6. Claims 10-11, 15-16, 19-20, 24-25 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

i) Regarding claim 10, in the phrase, "said sending unit sends a second identification 
information", the terms, "said sending unit" lacks sufficient antecedent basis since the 
claim comprises a "first sending unit" and a "second sending unit", "said sending unit" 
in the phrase will be considered as "said second sending unit." 

ii) Regarding claims 10, 17, and 19, "said stored reference" lacks sufficient antecedent basis. 

iii) Regarding claims 1 5, it is not clear as to what "its" is referring to in the claim. 
Furthermore, "the keyword ID" and "the associated keyword ID" lack sufficient, 
antecedent basis. 

iv) Regarding claim 24, it is not clear as to what "its" is referring to in the claim. 
Furthermore, "the keyword ID" and "the associated keyword ID" lack sufficient 
antecedent basis. 



Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

8. Claims 10, 17, and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over Sarachik et 
al. US Patent #6,816,628 (Sarachik hereinafter), in view of Tomsen et al. US Publication #2002/0083464 
(Tomsen hereinafter). 
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9. As per claims 10, 17, and 19, Sarachik teaches substantially the invention as claimed including a 
system for providing information across a computer network, said system comprising: 

an information registering device which includes a first display, a first positioning device and a 
first sending unit, said first display device displays an image of content rendered by a media, said first 
positioning device indicates a first object in said displayed image on said first display (col. 4, lines 38-40. 
Load video data. col. 4, lines 42-44. Designer selects portions of a video image to associate with screen 
annotations.), and said sending unit sends a first identification information containing a first object 
information relevant to said first desired object, a first keyword information entered by a user and a first 
reference information relevant to said content rendered by media (col. 4, lines 43-49. Assign textual 
information about object, marker of shirt, price, and name. Additional textual information, col. 4, lines 
50-60; col. 10, lines 39-47. Range over which objects appear. Information regarding location and shape 
of shirt stored as data structure, col. 5, lines 1-14. Time stamp data and frame identifier inputted. Col. 

10, lines 48-57. Generate mask, which represents location information such as by number in fixed 
relation, col. 1 1, lines 1-7, 33-35. Mask is associated with UID, timestamp, object mapping table. 
Object properties table.) to said computer network (col. 5, lines 25-30, 39-44. Annotation object data 
transferred to database. Col. 7, line 55-57. Annotation data may be stored in memory of receiver.); 

an information viewing device which includes a second display, a second positioning device and 
a second sending unit, said second display displays an image of content rendered by a media, said second 
positioning device indicates a second desired object in said displayed image on said second display (col. 
9, lines 35-39; col. 13, line 39-41. Viewer identify an item of interest using a device.), and said sending 
unit sends a second identification information containing a second object information relevant to said 
second desired object (col. 1 1 , lines 2 1 -24. Object mapping table includes a region number for each 
identified region, col. 13, line 39-41. Locate object properties table via object mapping table.); and 
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a database which receives said first identification information, said first keyword information and 
said first reference information from said information registering device through said computer network, 
links said first reference information with said first identification information and said first keyword 
information, stores said first reference information, and adds said first reference information to reference 
information stored before (col. 5, lines 25-30, 39-44. Annotation object data transferred to database. Col. 
7, line 55-57. Annotation data may be stored in memory of receiver, col. 11, lines 32-35. Object 
properties table stores references to the information about an object. It is inherent that information for 
more than one object may be stored.), 

wherein after said database receives said second identification information from said information 
viewing device through said computer network, said database searches for reference information linked 
with both said identification information among said stored reference information including said first 
reference information, and sends said reference information linked with both said second identification 
information to said information viewing device through said computer network (col. 5, lines 41-43, 48- 
52. Access annotation object data stored on the database when requested by the viewer, col. 13, lines 40- 
44. Locate object properties table via the object mapping table.); and 

wherein said information viewing device receives said reference information from said database 
through said computer network and displays said reference information on said second display (col. 13, 
lines 45-56. Display a primary dialog table that includes price and series of choices.). 

1 0. Sarachik teaches of receiving object identification information to retrieve information regarding 
the object. Sarachik does not specifically teach of a second keyword entered by another user to said 
computer network; second keyword information from an information viewing device; and searching 
reference information linked with both second identification and second keyword information among 
stored reference information; and sending the reference information linked with both said second 
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identification information and said second keyword information to said information viewing device 
through said computer network. 

Tomsen teaches of a similar system for retrieving information from a television broadcast, 
comprising: receiving second identification and second keyword information from an information 
viewing device (fig. 6. Paragraphs 0072; 0082. Request includes keyword, channel identifier, time 
index, etc.); searching reference information linked with both second identification and second keyword 
information among stored reference information (Paragraphs 0077-0078. Identify content based on time 
index. Paragraph 0082. Content source searches based on keywords.); and sending the reference 
information linked with both said second identification information and said second keyword information 
to said information viewing device through said computer network (fig. 7. 406b. Paragraph 0086. 
Supplemental content from time index and keywords. Paragraph 0092. Send search results.). 

It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the teachings of Sarachik and Tomsen for the second identification from the information 
viewing device as taught by Tomsen to be sent with a second keyword information; search reference 
information linked with both second identification and second keyword information among stored 
reference information; and sending the reference information linked with both said second identification 
information and said second keyword information to said information viewing device through said 
computer network. The motivation for the suggested combination is that Tomsen's teachings would 
allow searching of content based on different identification data and provide content based on finer 
granularity (Paragraph 0086). 

1 1 . Sarachik and Tomsen teach of a request comprising keyword information. However, Sarachik 
and Tomsen do not specifically teach of a user entering the keyword information. 
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Zernik teaches a similar system for an interactive television system, wherein a viewer can enter 
search query in the form of text (keyword information) to the Internet (Paragraphs 0040; 0076) and match 
the query to keywords on a web page (Paragraph 0063). 

1 2. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the suggested system of Sarachik and Tomsen with the teachings of Zernik for keywords in 
the request taught by the system to comprise keywords that a viewer enters as taught by Zernik. The 
motivation for the suggested combination is Zernik's teachings would allow a user to customize or 
specify the keyword search, which may allow responses more pertinent to user requests, and allow the 
user to conveniently retrieve additional information regarding a program (Paragraph 0076). 

13. Claims 1 1 and 20 are rejected Under 35 U.S.C. 103(a) as being unpatentable over Sarachik, 
Tomsen, and Zernik, in view of Arsenault et al, US Patent #6,925,650 (Arsenault hereinafter). 

14. As per claims 1 1 and 20, Sarachik does not specifically teach the system for providing 
information, wherein said database sends a stored keyword list prior to receiving said second keyword 
information from said information viewing device in response to inquiry made from said information 
viewing device. 

Arsenault teaches of sending a stored keyword list prior to receiving a second keyword from the 
viewer in response to inquiry made from the viewer (col. 1 1, line 64 - col. 12, line 11; col. 16, lines 55- 
65; col. 17, lines 11-31). 

15. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the suggested system of Sarachik, Tomsen, and Zernik with the teachings of Arsenault to send 
a stored keyword list prior to receiving a second keyword from the viewer in response to inquiry made 
from the viewer. The motivation for the suggested combination is that Arsenault's teachings would 
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enhance the user-friendliness of the system by allowing the viewer to efficiently select possible keywords 
to identify objects of interest. 

16. Claims 15-16 and 24-25 are rejected under 35 U.S.C. 103(a) as being unpatentable over Sarachik, 
Tomsen, and Zernik, in view of Abrahams US Publication #2002/0120934 

1 7. As per claims 1 5 and 24, Sarachik teaches the system for providing information as recited in 
claim 10, wherein said database comprises: 

a keyword table which has at least an ID field for uniquely identifying a record entry and a 
keyword field to contain the first keyword, wherein one record entry includes at least its ID and a 
keyword (fig. 5-2. "235". UID 232323. String Sportscap. Object properties table has 232323); 

a reference information table which has at least an ID field for uniquely identifying a record entry 
(fig. 5-2. Object properties table. 103124), a reference information field containing the first reference 
information (fig. 5-2. 222'. Price), and a keyword ID field to containing the keyword ID associated with 
the reference information (fig. 5-2. 221'. 232323), wherein one record entry includes at least its ID, 
reference information, and the associated keyword ID (fig. 5-2. 103124. 232323); 

a target image object table which has at least an ID field for uniquely identifying a record entry 
(fig. 5-2. 217. UID 01234.), and an link ID field containing the ID of reference information linked with 
the object (fig. 5-2. Object mapping table comprises UID 103124.), wherein one record entry includes at 
least its ID, media information, and the ID of reference information linked with the object (fig. 5-2. 217. 
Object number 2. UID 103124). 

18. Sarachik does not specifically teach of time and frame field containing information to identify 
media information. 
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Abrahams teaches a similar system for interactive television comprising of time and frame 
information (Paragraphs 0047-0048). 

19. It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the suggested system of Sarachik, Tomsen, and Zernik with the teachings of Abrahams to 
comprise time and frame information. The motivation for the suggested combination is that Abrahams' 
teachings would provide additional identification to allow matching of selection information to accurate 
identify and display information. 

20. As per claims 1 6 and 25, Sarachik teaches the system for providing information, wherein: said 
content rendered by media is video image information distributed by TV broadcasting (col. 3, lines 30-34. 
Television broadcast.); said first identification information further includes at least any of a broadcasting 
channel over which the content was or will be broadcasted, receiving area, specified time length (col. 5, 
lines 1-10. Timestamp data. Timing information.); said first keyword information includes at least any of 
a keyword, keyword ID number, keyword type, specified time length, time when the keyword was 
registered, and a number of times the keyword has been selected as user preference (col. 4, lines 45-50. 
Name of distributor, maker of shirt, textual information, col. 1 1, 44-45. Name of shirt.). However, 
Sarachik does not specifically teach said reference information includes a URL that designates a Web 
site/page on the Internet. 

Abrahams teaches a similar system for interactive television, wherein reference information 
including a URL that designates a web site on the Internet is sent to a viewer (Paragraph 0049-0050). 

21 . It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to combine the suggested system of Sarachik, Tomsen, and Zernik with the teachings of Abrahams to sent 
reference information including a URL that designates a web site on the Internet. The motivation for the 
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suggested combination is that Abrahams' teachings would allow a user to access additional information 
regarding an object of the interest by accessing information on the Internet (Paragraph 0050). 

Conclusion 

22. A shortened statutory period for reply to this Office action is set to expire THREE 
MONTHS from the mailing date of this action. 

23. Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to Joshua Joo whose telephone number is 571 272-3966. The examiner can normally be 
reached on Monday to Thursday 8AM to 5PM and every other Friday. 

24. If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Nathan J. Flynn can be reached on 571 272-1915. The fax phone number for the organization where this 
application or proceeding is assigned is 571-273-8300. 

25. Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained 
from either Private PAIR or Public PAIR Status information for unpublished applications is available 
through Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



September 13, 200'£i$p€5 
JJ 




